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and  social  events,  the  Annual  Acquisition  Research  Symposium  offers  a  candid 
environment  where  high-ranking  Department  of  Defense  (DoD)  officials,  industry 
officials,  accomplished  faculty  and  military  students  are  encouraged  to  collaborate 
on  finding  applicable  solutions  to  the  challenges  facing  acquisition  policies  and 
processes  within  the  DoD  today.  By  jointly  and  publicly  questioning  the  norms  of 
industry  and  academia,  the  resulting  research  benefits  from  myriad  perspectives  and 
collaborations  which  can  identify  better  solutions  and  practices  in  acquisition, 
contract,  financial,  logistics  and  program  management. 

For  further  information  regarding  the  Acquisition  Research  Program, 
electronic  copies  of  additional  research,  or  to  learn  more  about  becoming  a  sponsor, 
please  visit  our  program  website  at: 

www.acquistionresearch.org 

For  further  information  on  or  to  register  for  the  next  Acquisition  Research 
Symposium  during  the  third  week  of  May,  please  visit  our  conference  website  at: 

www.researchsvmposium.org 


ACQUISITION  RESEARCH:  CREATING  SYNERGY  FOR  INFORMED  CHANGE  -  i  - 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


ACQUISITION  RESEARCH:  CREATING  SYNERGY  FOR  INFORMED  CHANGE  -  ii  - 


Incentive  Contracts:  The  Attributes  that  Matter  Most  in  Driving 
Favorable  Outcomes 


Presenter:  Robert  L.  Tremaine,  is  an  Associate  Dean  for  Outreach  and  Performance  Support  at  the 
Defense  Acquisition  University’s  West  Region  campus  in  San  Diego,  CA.  He  is  an  Air  Force  Academy 
graduate  and  holds  a  Master’s  of  Science  in  Systems  Management  (Research  and  Development)  from 
the  Air  Force  Institute  of  Technology.  He  is  a  retired  Air  Force  colonel  with  over  25  years’  experience  in 
air,  missile,  and  space  weapon  systems  acquisition. 


Abstract 

Incentive  contracts  have  been  in  place  for  many  years.  They  represent  just  one  of 
many  contractual  tools  the  Department  of  Defense  has  at  its  disposal  to  drive  certain 
performance  behaviors.  Lately,  the  usefulness  of  incentive  contracts  has  come  into  question. 
The  dividends  have  not  been  readily  apparent.  This  research  study  set  out  to  determine  what 
generally  afforded  strong  correlations  between  incentive-type  contracts  and  expected 
performance  outcomes.  Twenty-five  weapon  system  acquisition  programs  offices  were 
interviewed  in  various  stages  of  their  acquisition  lifecycles.  A  standardized  questionnaire- 
survey  was  used  to  capture  the  data.  This  presentation  prepared  for  the  Fourth  Annual 
Acquisition  Research  Symposium  will  address  the  findings  and  include  a  few  key 
recommendations  intended  to  better  arm  the  acquisition  workforce  on  the  use  of  incentive 
contracts. 

Discussion 

In  the  past  several  years,  major  weapon  system  development  programs  have  drawn 
significant  attention.  The  reasons  are  varied.  In  some  cases,  costs  have  skyrocketed; 
schedules  have  experienced  significant  delays;  and  performance  levels  have  failed  to  meet 
government  expectations  despite  the  employment  of  management  tools  designed  to  control 
costs,  preserve  schedules  and  influence  performance  outcomes.  Some  of  these  management 
tools  (including  contractual  measures,  as  originally  conceived  and  specified  by  the  Federal 
Acquisition  Regulations  (FARs))  can  give  tremendous  flexibility  to  the  implementation  of 
government  contracts.  The  use  of  such  contractual  measures  is  one  of  many  handy  tools  in  a 
program  manager’s  toolkit  to  help  drive  performance  behavior.  However,  the  GAO  recently 
identified  an  apparent  disconnect  between  the  use  of  certain  measures  like  incentives  and 
expected  outcomes  in  weapon  system  acquisitions.  In  short,  it  appeared  that  incentives  were 
not  driving  performance  outcomes  as  originally  envisioned. 

So,  what  about  incentives?  Are  they  still  a  good  tool  to  drive  performance  behaviors 
despite  the  recent  criticism  and  doubt?  Have  organizations  found  a  way  to  effectively  apply 
incentives  and  demonstrate  the  usefulness  of  incentives?  The  answer  to  all  of  these  questions 
is,  “yes.”  There  is  no  “one  size  fits  all,”  but  the  incentive  attributes  that  seemed  to  matter  the 
most  in  influencing  performance  outcomes  for  the  25  programs,  and  generally  afforded  strong 
correlations  between  incentives  and  desired  performance  were  indicated  by  the  findings. 
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Conclusion 


Strongly  Communicated  Expectations  and  Feedback:  Frequent  and  unambiguous 
communication/feedback  made  a  noticeable  difference  for  incentive  contracts.  Even 
though  incentive  contracts  require  some  additional  administrative  burden,  the  outcome  justified 
the  increased  workload  of  feedback  for  most  programs  under  this  research  review.  Continuous 
and  open  dialogue  at  both  junior  and  senior  levels  led  to  early  discovery  and  timely 
reconciliation  of  many  known  issues  and  helped  keep  a  program  on  track. 

Metrics:  The  selection  of  key  and  enduring  measures  within  an  evaluation  period 
and  of  measures  that  could  be  connected  to  subsequent  evaluation  periods  made  a 
noticeable  difference  for  incentive  contracts.  Key  measures  can  validate  whether  or  not  a 
program  achieved  certain  necessary  intermediate  milestones  along  a  program’s  critical  glide 
path.  They  confirm  program  momentum.  They  served  as  an  early  warning  system — a  bell 
weather — and  answer  the  age  old  question,  “Are  we  on  track”?  They  also  fill  a  huge  role  as 
performance  benchmarks.  Those  interviewed  under  this  research  project  said  when  they 
effectively  employed  key  measures,  such  tools  also  helped  them  navigate  their  program 
pathway  despite  the  unavoidable  programmatic  turbulence.  Their  measures  surfaced  either  as 
two  types:  objective  and/or  subjective.  Without  question,  selecting  the  correct  type  of  measures 
presented  the  biggest  challenge.  The  ability  to  hard-wire  them  to  achievable  outcomes  makes 
objective  measures  like  Technical  Performance  Measures  (TPMs),  Cost  Performance  Indices 
(CPIs),  Schedule  Performance  Indices  (SPIs),  etc.,  invaluable  gauges.  They  served  as 
tremendous  forecasting  devices  when  they  were  carefully  connected  to  outcomes. 

Base  Fee:  The  incorporation  of  base  fee  in  award-fee  contracts  made  a  noticeable 
difference.  Of  the  25  organizational  interviews,  many  used  some  form  of  base  fee  on  cost- 
plus-award-fee  contracts.  Numerous  organizations  implementing  cost-plus-award-fee  (CPAF) 
valued  base  fees  as  a  leverage  tool.  Even  though  the  Federal  Acquisition  Supplement 
(DFARS)  216.405-2( c)(iii)  allows  up  to  3%  of  the  estimated  cost  of  the  contract  exclusive  of  fee, 
a  contractor  could  provide  “best  efforts”  for  the  award-fee  term  and  still  receive  no  award.  As  a 
result,  there  was  some  pressure  on  the  government  to  provide  a  portion  of  the  award  fee  for 
“best  efforts.”  Further,  our  research  team  found  that  senior  defense  industry  personnel 
welcomed  the  use  of  base  fee  to  better  delineate  the  difference  between  “best  efforts”  (e.g.,  fee) 
and  “excellence”  (e.g.,  award). 

Trained  and  Experienced  Personnel:  Training  and  experience  made  a  noticeable 
difference  for  incentive  contracts.  Nothing  seems  to  have  a  more  dramatic  impact  in  DoD 
like  training  and  experience.  Training  draws  it  roots  from  practical  experience.  It’s  systematic. 
We  learn  from  our  successes  and  failures  in  the  field  and  make  adjustments  accordingly  in  the 
way  we  train.  The  mantra,  “we  train  like  we  fight  and  fight  like  we  train”  is  pervasive  within  the 
warfighter  arena  and,  ultimately,  leads  to  advantages  on  the  battlefield.  Without  question, 
practical  experience  helps  build  better  training  programs.  It  can  overcome  unforeseen  shortfalls 
and  the  inevitable  prevailing  uncertainty  even  within  proven  systems.  It’s  no  different  for 
incentive-type  contracts.  Organizations  that  had  formalized  instruction  and/or  coached  their 
personnel  on  the  use  of  incentives  indicated  such  training  more  favorably  influenced  outcomes. 

The  exploitation  of  an  increasingly  popular  collaborative  medium  called  Communities  of 
Practices  (CoPs)  on  the  DAU  Acquisition  Community  Connection  offers  access  to  these 
particular  techniques  and  an  even  wider  array  of  current  experiences  and  lessons  learned 
regarding  incentives  ranging  from  the  general  to  the  specific.  The  DAU  has  already  established 
a  site  on  the  ACC,  Award  and  Incentive  Fee  Contracts.  See 
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(https://acc.dau.mil/CommunitvBrowser.aspx7icM  05550).  These  and  other  collaborative 
training  aids  are  critical  because  once  an  incentive  strategy  is  in  place,  its  maximum  value  truly 
depends  on  its  ability  to  implement  techniques  that  drive  favorable  outcomes.  There’s  no  better 
source  of  experts  who  face  contract  incentive  challenges  every  day  than  the  acquisition 
workforce  who  is  charged  with  appropriately  implementing  the  techniques  that  drive  outcomes, 
appreciably. 
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2003  -  2006  Sponsored  Acquisition  Research  Topics 

Acquisition  Management 

■  Software  Requirements  for  OA 

■  Managing  Services  Supply  Chain 

■  Acquiring  Combat  Capability  via  Public-Private  Partnerships  (PPPs) 

■  Knowledge  Value  Added  (KVA)  +  Real  Options  (RO)  Applied  to  Shipyard 
Planning  Processes 

■  Portfolio  Optimization  via  KVA  +  RO 

■  MOSA  Contracting  Implications 

■  Strategy  for  Defense  Acquisition  Research 

■  Spiral  Development 

■  BCA:  Contractor  vs.  Organic  Growth 
Contract  Management 

■  USAF  IT  Commodity  Council 

■  Contractors  in  21st  Century  Combat  Zone 

■  Joint  Contingency  Contracting 

■  Navy  Contract  Writing  Guide 

■  Commodity  Sourcing  Strategies 

■  Past  Performance  in  Source  Selection 

■  USMC  Contingency  Contracting 

■  Transforming  DoD  Contract  Closeout 

■  Model  for  Optimizing  Contingency  Contracting  Planning  and  Execution 
Financial  Management 

■  PPPs  and  Government  Financing 

■  Energy  Saving  Contracts/DoD  Mobile  Assets 

■  Capital  Budgeting  for  DoD 

■  Financing  DoD  Budget  via  PPPs 

■  ROI  of  Information  Warfare  Systems 

■  Acquisitions  via  leasing:  MPS  case 

■  Special  Termination  Liability  in  MDAPs 
Logistics  Management 

■  R-TOC  Aegis  Microwave  Power  Tubes 

■  Privatization-NOSL/NAWCI 

■  Army  LOG  MOD 
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PBL  (4) 

Contractors  Supporting  Military  Operations 
RFID  (4) 

Strategic  Sourcing 

ASDS  Product  Support  Analysis 

Analysis  of  LAV  Depot  Maintenance 

Diffusion/Variability  on  Vendor  Performance  Evaluation 

Optimizing  CIWS  Lifecycle  Support  (LCS) 


Program  Management 


Building  Collaborative  Capacity 

Knowledge,  Responsibilities  and  Decision  Rights  in  MDAPs 
KVA  Applied  to  Aegis  and  SSDS 

Business  Process  Reengineering  (BPR)  for  LCS  Mission  Module  Acquisition 
Terminating  Your  Own  Program 
Collaborative  IT  Tools  Leveraging  Competence 


A  complete  listing  and  electronic  copies  of  published  research  within  the  Acquisition 
Research  Program  are  available  on  our  website:  www.acauisitionresearch.org 
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DEFENSE 

ACQUISITIONS 

DOD  Has  Paid  Billions 
in  Award  and 

Incentive  Fees 
Regardless  of 
Acquisition  Outcomes 

A 
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Why  GAO  DidHShis  Study 


GAO  was  asked  to  determine 
whether  award  and  incentive  fees 
have  been  used  effectively  as  a  tool 
for  achieving  DOD’s  desired 
acquisition  outcomes.  To  do  this, 
GAO  selected  a  probability  sample 
of  93  contracts  from  the  study 
population  of  597  DOD  award-  and 
incentive-fee  contracts  that  were 
active  and  had  at  least  one  contract 
action  valued  at  $10  million  or  more 
from  fiscal  year  1999  through  2003 


Presented  by  Rob  Tremaine 


Associate  Dean  for  Outreach  &  Performance  Support 
Defense  Acquisition  University 
West  Region 
San  Diego,  CA  92147 

619-524-481 1  robert.tremaine@dau.mil 
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£AU  .  The  PROBLEM  : 

Defense  Acquisition  University  GAO  Found  Award/Incentive  Fee  Generally  Ineffective 
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Despite  paying  billions  in  fees,  DOD  has  little  evidence  to  support  its  belief 

Uhi.  I  iUr-s<'  h-r-s  1 1 1  if  it  h  1  i  ^  H  1 1  i .  i.  *  I  h  M  [n't  h  h  Llh  1 1  M  i  ■  j.ml  . n  qn M  I  I . . . 

TIm'  <  h  '■]  '-.111  llM'lli  ibis  jH  H  .  1  ^LifLliHl  iln  .L  ri  Un  d  <  -i  I  qju.lYM'S,  m  A  Y-s  A]  r-U 
|  |H.4lor(ii:.iist  ■  iiii  inim  Inevnluab  i\u  i  (Tim  fio  ih  of  iiU  and  m  enliv< 
fees.  In  addition,  when  (contracts  have  utilized  different  fee  strategies  to 
I  focus  the  contractor’s  attention  on  specific  acquisition  outcomes, 
contracting  officials  have  stated  that  DOD  has  few  mechanisms  to  share 
lessons  learned  and  innovative  practices  outside  the  local  level. 


What  GAO  Found 

The  power  of  monetary  incentives  to  motivate  excellent  contractor 
performance  and  improve  acquisition  outcomes  is  diluted  by  the  way  DOD 
structures  and  implements  incentives.  While  there  were  two  examples  in  our 
sample  in  which  the  Missile  Defense  Agency  attempted  to  link  award  fees 

directly  to  desired  acquisition  uiiin  him^.  on  h  .is  <  k . .  l  .u  in^  .1  ■  1  j  1 1 1 1 1 1 1 

witliin  an  established  schedule,  award  fees  are  gor  rally  in  *1  linked  u  > 

.n  -1||||S|I  Son  oiHrontr-s  As  4  h-sillk  ]  H  d  1  |.m>  paid  <  Hli  a] h  -si  1j  imNh I  b.H  UlllhMi 
in  awar  d  fees  le  dale  on  cuiitrarls  in  our  sludy  population.  regardless  of 
tmlcomes  The  following  selected  programs  show  this  discoimec  . 

Program  Performance  and  Award-Fee  Payments  on  Selected  DOD  Development  Programs 

Comanche  F/A-22  Raptor  Joint  Strike  Space-Based 

reconnaissance  tactical  fighter  Fighter  tactical  Infrared 

Acquisition  outcomes  attack  helicopter  aircraft _ fighter  aircraft  System  High 

Research  and  $3.7  hi  lion  $1 0.2  billion  $10.1  billion  $3.7  billion 

development  cost  41.2  percent  47.3  percent  30.1  percent  99.5  percent 

inorease  over  baseline _ 

Acquisition  cycle  time  33  months  27  months  11  months  More  than  12 

i n creas e  o  ve r  b asel i n e  1 4. 8  pa rce nt _ 1 3. 3  pe rce nt  5 . 9  p eroe nt _ months _ 

Percentage  and  total  85  percent  91  percent 

award  fee  paid  to  prime  $2D2.5  million  $848.7  million 

systems  contractor  paid  through  2004 
Jadjuste^onjolloverjd 

Sources:  DOD  submissions  to  GAO,  contract  documentation,  and  GAO-05-301  (data);  GAO  (analysis). 

When  calculating  the  percentage  of  award  fee  paid  (i.e..  percentage  of  award  fee  paid  =  total  fee 
paid  to  date  /  [total  fee  pool  -  remaining  fee  pool)),  we  included  rolled -over  fees  in  the  remaining  fee 
pool  when  those  fees  were  still  available  to  be  earned  in  future  evaluation  periods. 


100  percent  74  percent 

$494.0  million  $1 60.4  million 


What  GAO  Recommends 


GAO  recommends  that  DOE) 
improve  its  use  of  fees  'by 
specific  ally  tying  them  t<  j 
acquisition  outecaties  in  all  new 

award-  and  incentive-fee  contracts, 
maximizing  contractors1  motivation 
to  perform,  and  collecting  data  to 
evaluate  the  effectiveness  of  fees. 

In  its  comments  on  a  draft  of  this 
report,  DOD  concurred  or  partially 
concurred  with  all  of  the 
recommendations. 
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Incentive  Contracts  Have  Been  Used  in 
Various  Forms  for  Some  Time 
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Source:  http://findarticles.eom/p/artides/mi_m0IBO/is_2_25/ai_79210046 
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Simplified  View  of  Incentive  Contracts 


INCENTIVE  CONTRACTS 

(FAR  16.401) 

Designed  to  obtain  specific  acquisition 
objectives 

Establishes  reasonable  and 
attainable  targets  that  are  clearly 
communicated 

Includes  appropriate  incentive 
arrangements  designed  to: 

-  Motivate  contractor  efforts  that  might 
not  otherwise  be  emphasized 

-  Discourage  contractor  inefficiency 
and  waste 


Cost  Plus  Incentive  Fee 


Share 

Ratio 


Cost  Plus  Award  Fee 

Max 

Fee 

Award  Fee  Pool 

Base 

Fee 

Award  Fee  Base  0-3% 

Estimated  Cost 

Fixed  Price  Incentive  Fee 


I  Incentive  Contracts: 

«“Ss!  A  Sampling  of  Recent  Assessments  and  Guidance 


Army  (ACA)  Award  Fee  Board  Member 
Guide  (September  2003) 


Air  Force  (AFMC)  Award  Fee  &  Award 
Term  Guide,  Dec  2002 


Air  Force  (Secretary  of  the  Air  Force)  Contract 
Incentives  Policy  06A-003  -  April  04,  2006 


Air  Force  Award  Fee  Guide  -  March  2002 


DCAA  Contract  Audit  Manual,  March  2006 


DFARS  SUBPART  216.4-INCENTIVE 
CONTRACTS  (Revised  March  21,  2006) 


USAID 

non  ihn  AMiKitAN  num 


USAID  Guidance  for  Award 
Fee  Contracting 


Air  Force  (SAF/AQC)  Award  Term/Incentive 
Options  Guide  -  January  2003 


Army  (ACA)  Award  Fee  Contracts  Guide 
(September  2003) 


Army  (ACA)  Cost  &  Price  Analysis 
Handbook,  February  2004 


Army  (U.S.  Army  Audit  Agency)  -  Best 
Practices  for  Using  Award  Fees,  Audit  Report 
AA  01-169,  February  2001 


2001  Incentive  Strategies  for  Defense 
Acquisitions  Guide 


OUSD  Award  Fee  Contracts  (FAR  16,  DFARS  215, 
DFARS  216)  Policy  Memo,  March  29,  2006 


2006  Secretary  of  the  Air  Force  for  Acquisition 
Directorate  (SAF/AQX)  Contract  Incentives  Study 


Air  Force  Space  Command’s  Space  &  Missile 
Center  (SMC)  2006  Draft  Incentives  Guide 


2007  National  Defense  Authorization  Act,  PUBLIC 
LAW  109-364— OCT.  17,  2006,  SEC.  814 
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1  Urrited  SlJil-^t  fJovi-imn^nl  l  Account  ntd  Lit  t  C>iTI£S-',r-  l 

GAO 

Report  to  the  Subcommittee  on 

Readiness  and  Management.  Support, 

<  -ommittee  on  Armed  Services, 

TJ.S.  Senate 

]i-."f"mbe-rS0O& 

DEFENSE 

ACQUISITIONS 

DOD  Has  Paid  Billions 
in  Award  and 

Incentive  Fees 
Regardless  of 
Acquisition  Outcomes 

A 

a  G  A  o 

-  Ira  arty  -  Rrtbt-'lr, 

Why  GAO  Didnhis  Study 


GAO  was  asked  to  determine 
whether  award  and  incentive  fees 
have  been  used  effectively  as  a  tool 
for  achieving  DOD’s  desired 
acquisition  outcomes.  To  do  this, 
GAO  selected  a  probability  sample 
of  93  contracts  from  the  study 
population  of  597  DOD  award-  and 
incentive-fee  contracts  that  were 
active  and  had  at  least  one  contract 
action  valued  at  $10  million  or  more 
from  fiscal  year  1999  through  2003 
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Research  Problem  Statement  &  Objective 


Problem  Statement 

•  The  Implementation  of  Award/Incentive  Fee  contracts  in  DoD  are  not 
producing  the  desired/intended  outcomes.  In  some  cases,  the  Acquisition 
community  may  not  be  implementing  Award  Fee/Incentive  contracts,  correctly. 

Research  Objective 

•  DAU  needs  to  understand  where  Award  Fee/Incentive  Fee  made  a 
favorable  difference  and  why. 

The  Teams’  Outcome  Will  Be  A  Research  Project  Rather  than  a  Re-clama 
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Multi-Regional 

Award/Incentive  Fee  Study  Team 


DAU  M id  West 
2  Alan  Gilbreth  "jr' 
2  Syl  Hubbard 


DAU  West 
Rob  Tremaine 


OSD 

Mr  Mike  Canales 


Capital  Northeast 
2  Karen  Byrd 
2  Lenny  Manning 
2  Leslie  Deneault 


DAU  South 
2  Ralph  Mitchell 


1  Study  Lead 

2  Regional  Reps 

3  OSD  Rep 
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Research  Assumptions 


Award/Incentive  Fee  Assumptions: 

1.  Improved  Contractor  Performance  Has  Not  Always  Been  Achieved  Through  the 
Use  Of  Award  Fee/Incentive  Fee  Contracts. 

2.  GAO  Has  Identified  Numerous  Award/Incentive  Fee  Contracts  that  Have  Cost 
the  Government  Millions  Without  Always  Producing  Desired  Contractual 
Outcomes. 

3.  In  DoD  Contracting,  Award/Incentive  Fee  Contracts  Can  Be  Powerful  Tools  to 
Favorably  Influence  Contractor  Performance  in  conjunction  with  good  acquisition 
fundamentals. 

4.  Empirical  Evidence/Measurable  Results  Should  Play  a  Pivotal  Role  In 
Award/Incentive  Fee  Determinations. 

5.  GAO  Conclusions  on  the  Ineffectiveness  Of  Award/Incentive  Fee  Contracting 
May  Be  A  Result  Of  Certain  Ineffective  Practices  that  Could  Be  Undermining 
Policy 


Exchange  with  the  GAO 


Met  with  Mr  Tom  Denomme  and  Mr  Ron  Schwenn  on  20  Jun  06  at  GAO  HQ 
in  DC —  very  informative  exchange — their  comments: 

•  Research  effort  looked  for  connection  between  AF/IF  and  favorable  outcomes 
but  they  found  little  evidence  to  substantiate  relationship 

•  Process  seemed  to  be  well  understood — no  chronic  problems 

•  Found  no  issues  with  Policy 

•  Service  Guidelines  governing  implementation  of  AF/IF  is  different — should  it  be? 

•  Award  Fee  sometimes  drives  requirements  creep 

•  Performance  outcomes  were  sometimes  unrealistic-contractor  couldn’t  deliver 

•  Surprisingly,  TPMs  didn’t  seem  to  play  much  into  the  equation 

•  GAO  did  not  evaluate  weighting  methodology-would  it  have  made  a  difference? 

•  In  some  cases,  AF  was  seen  and  used  by  PM  as  a  “Risk  Management”  device — is 
that  a  bad  idea? 

•  FDO’s  final  evaluation  letters  don’t  contain  much  substantiation — why  is  it  so 
general? 

•  The  contractor  isn’t  encouraged  to  pursue  alternate  COAs  especially  if  they  or  the 
government  run  into  [anticipated]  programmatic  obstacles 
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Survey  Approach  Used  A  WBS  Approach 

rm 
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hy 

Stage  Setters  Expectations? 


1.1.1  ACATType 

1.1.2  Program  O 

1.1.3  Component 

1.1.4  Interviewees 


Metrics? 


i 

1.2.1  Programmatic  Hurdles 

ii 

1.3.1  Subject  Evaluation  that  1 

drove  outcomes  [ 

i 

1.2.2  Technology  Hurdles 

1 .3.2  Changes  to  Criteria  that  1 

drove  Outcomes  ] 

! 

1.2.3  Pushing 

Technology  Envelope 

1.3.3  Balance  between  Subject  1 

&  Objective  1 

1.2.4  Strong  links  to 
Performance 

1.3.4  Scoring  Methodology  1 

Problem  Statement 


1.4.1  Actions  that  Influenced 
Programmatic  Risks 

1.4.2  Actions  that  Influenced 
Technical  Risks 

1.4.3  Unintended 
Consequences  &  Mitigation 


1.4.4  Unintended  Consequences 
&  Determinations 


General 
Categories? 

1.5.1  Award  Fee  Authority 

1 1.5.2  Difference  between  FDO 
land  PM 

1.5.3  FDO  Determination  & 
Influence  on  Outcomes 

1.5.4  Award  Period  Length 


1.3.7  Subjective  vs  Objective 


1.3.8  Reason  for  Base  Fee  and  % 
selected 


1.5.7  Contractor  View  of  Award  Fee  | 

Strategy _ 

1.5.8  Reasons  if  Award  Fee 
Strategy  is  seen  as  ineffective 

1.5.9  Changes  required  to 
influence  outcomes 

1.5.10  Other  Interviewee  Comments! 


Data  Collection  Instrument 
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INCENTIVE  FEE  and  AWARD  FEE  SURVEY  QUESTIONS 

SECTION  I.  PROGRAMMATICS 


1 .  What  best  describes  your  program? 

a.  AC  AT  I 

b.  ACATIA 

c.  ACATII 

d.  ACATIII 

e.  Other 

2.  What  best  characterizes  your  prograrr 

a.  System  Development  &  Demonst 

b.  Production  and  Deployment 

c.  Operations  &  Support 

d.  Other 


SECTION  II:  INCENTIVE  FEE  (defined  as  CPIF  and  FPIF  type  contracts) 


EXPECTATIONS 

1.  What  incentives  did  you  use? 

2.  Why  did  you  choose  these  incentive! 

3.  Did  the  incentives  you  chose  create  i 

4.  If  you  faced  funding  issues,  what  act 
contractor  to  help  sustain  favorable  j 


SECTION  III.  AWARD  FEE  (Defined  as  CPAF  and  I  P 


B.  METRICS 

1 .  How  did  you  determine  the  minimu 
motivated  the  contractor  to  perform 

2.  What  metric(s)  did  you  use  to  incen 
of  methodology  did  you  use? 

3.  How  did  your  methodology  lead  to 

C.  OUTCOMES 

1 .  Did  the  contractor  stay  within  the  co 
what  were  the  outcomes  in  terms  of 

2.  If  as  a  result  of  the  incentives  used  tl 
mitigate  those  consequences  in  fiitu 

3.  In  retrospect,  which  of  the  incentives 
overcome  unintended  consequences 
performance  outcomes? 


A.  EXPECTATIONS 

1 .  What  were  your  primary  programmatic  hurdles? 

2.  What  were  your  primary  technology  hurdles? 

3.  Where  are  you  pushing  the  technology  envelope? 

4.  What  were  your  award  fee  objectives  that  created  : 

5.  How  did  you  establish  the  criteria  used  in  the  awar 

6.  What  programmatic  and/or  technical  impediments 
reconciled  during  the  Award  Fee  periods? 

Did  you  and,  if  so,  how  did  you  use  EVMS  to  infh 
If  you  faced  funding  issues,  what  Award  Fee  actio 
contractor  to  help  sustain  favorable  performance  o 

B.  METRICS 

1 .  What  were  your  subjective  evaluation  criteria  that 

2.  What  changes  did  you  make  to  the  award  fee  critei 
that  drove  favorable  outcomes  and  why? 

How  did  you  determine  the  balance/share  between 
and  what  had  the  most  favorable  impact  on  perfon 
What  was  your  scoring  methodology? 

How  did  your  scoring  methodology  (and  rating  de: 
performance  outcomes? 

What  criteria  did  you  weigh  more  heavily  that  had 
outcomes? 

What  did  you  weigh  evenly  and  why  did  this  weig 
performance  outcomes? 

Could  you  have  replaced  any  of  the  subjective  criti 
have  favorable  impacts  on  performance  outcomes? 
If  you  used  a  Base  Fee,  why  did  you  use  it  and  wh< 

C.  OUTCOMES 

1.  What  specific  Award  Fee  actions  did  you  take  that 

a.  Programmatic  risks? 

b.  Technical  risks? 

In  retrospect,  what  worked  consistently  in  the  Awa 
favorable  performance  outcomes? 

3a.  If  your  expected  performance  outcomes  led  to  uni 
how  did  you  mitigate  those  unintended  consequen 
3b.  Did  those  unintended  consequences  have  an  impai 
contractor? 

3c.  Did  you  have  the  authority  to  change  or  eliminate 
a  result  of  unintended  consequences? 

3d.  In  retrospect,  what  methods  did  you  find  that  worl 
overcome  unintended  consequences  and  still  pron 
performance  outcomes? 


Under  Configuration  Control:  2006  0702  Version  6 

2.  If  the  Award  Fee  Determination  Official  (FDO)  was  different  from  the  Program 
Manager/Program  Director,  was  the  Award  Fee  decision  different  than  what  the  PM 
recommended?  If  so,  why? 

3.  How  did  the  FDO  determination  favorably  influence  the  expected  outcome? 

4  If  earlier  Award  Fee  decisions  realized  less  tangible  outcomes,  what  subjective  or 
objective  criteria/weighting  were  changed  in  subsequent  award  fee  periods  to 
influence  favorable  performance  outcomes  and  why? 

5.  What  is  the  length  of  time  between  your  award  fee  periods?  Why  did  you  select  that 
period  of  time?  Were  they  too  short  or  too  long? 

6.  How  does  your  organization  view  your  Award  Fee  strategy?  Please  elaborate  after 
your  response. 

a.  Very  effective  in  motivating  the  contractor 

b.  Moderately  effective  in  motivating  the  contractor 

c.  Somewhat  effective  in  motivating  the  contractor 
c.  Not  very  effective  in  motivating  the  contractor. 

7.  If  you  answered  “D”  above,  what  is  the  principle  reason  your  organization  might  view 
Award  Fee  as  “not  very  effective”?  Please  elaborate  after  your  response. 

a.  Not  everyone  is  well-trained  on  Award  Fee 

b.  Not  everyone  is  aware  of  the  complicating  factors  that  are  considered  in  the 
decision  equation. 

c.  Other 

8.  How  does  your  contractor  view  your  Award  Fee  strategy? 

9.  In  retrospect,  what  changes,  if  any,  would  you  make  to  the  Award  Fee  Plan  to 
influence  performance  outcomes  even  more? 

10.  What  has  been  your  Contractor  response  to  your  determinations? 

1 1 .  What  other  comments  to  you  have  concerning  Award  Fee? 
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Incentive  Contract  Study  Interviews 

By  Region 
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. . .  and  the  Findings  Say: 


1.  Strongly  Communicate  Expectations  and  Continually 
Provide  Feedback 


•  Establish  Open  dialogue  at  both  Junior  and  Senior  levels 

•  Ensure  that  Contractor  is  never  surprised  by  what  they  get 

•  Employ  “Emphasis  letters”  or  “Barometer  reports”  during 
award  periods  to  stress  the  importance  of  certain 
“outcomes”  or  “events” 

•  Conduct  Monthly  reviews 

•  Set  and  Maintain  Unequivocal  Expectations 

•  Enforce  a  strongly  prepared  and  focused  evaluation  board 
that  also  garners  upper  management  support 
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. . .  and  the  Findings  Say: 


2.  Use  Relevant,  Achievable  and  Enduring  Measures 
Within  an  Evaluation  Period 

*  “Hard-wire”  measures  to  achievable  outcomes 

*  Employ  technical  performance  goals  and  cost  controls 

*  Jointly  develop  incentive  criteria  with  contractors  since  they 
tend  to  be  more  strongly  correlated  to  outcomes 

*  Select  Key  outcomes  that  make  evaluation  periods  more 
enduring  by  creating  a  bridge  between  one  award  fee  period 
and  the  next 

*  Use  subjective  measures  to  drive  critical  processes, 
management  responsiveness,  and  certain  behavior 

*  Institute  a  combined  objective  and  subjective  measures 
strategy 
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.  and  the  Findings  Say: 


3.  Use 


in  Award  Fee  Contracts 


*  Set  aside  a  portion  of  the  award  fee  funding  for  “best 
efforts” 

*  Set  aside  a  portion  of  the  award  fee  funding  to  give 
ample  flexibility  for  “excellence” 

*  Factor  in  the  view  of  Senior  defense  industry 
personnel — they  welcomed  the  use  of  base  fee  to  better 
delineate  the  difference  between  “best  efforts”  (e.g.  fee) 
and  “excellence”  (e.g.  award) 
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. . .  and  the  Findings  Say: 


4.  Institute  Training  and  Leverage  Experienced 

Personnel  to  the  Maximum  Extent 

*  Incorporate  the  practical  experience  of  many 
already  embedded  talented  personnel 

*  Establish  formalized  instruction  and  continue  to  coach 
personnel  on  use  of  incentives 

*  Require  performance  monitors  to  observe  other 
assessments  to  help  them  appreciate  the  depth  of 
evaluations 

*  Encourage  “Specialty”  training  for  key  personnel  who 
administer  incentive  contracts 


£AU  . . .  and  the  Findings  Say: 

Defense  Acquisition  university  20  July  2006  Industiy  Day  Themes  collected  at  DAU  Headquarters 


5.  Carefully  Weigh  Industry  Concerns 


Government  Construction  of  the  Award  Fee  Plan  (Including  Metrics,  incentives,  etc.) 
May  Not  Link  With  the  Offeror’s  Proposed  Solution  Or  Motivations 
Award  Fee  Sometimes  isn’t  Proper  Contract  Type  to  Achieve  Program  Outcomes 
In  Some  Cases,  the  intended  Goal(s)  of  Award  Fee  Contracts  are  Unclear 
Contracts  Without  Base  Fee  Can  Cause  Problems 

In  Some  Cases,  the  Government  Does  Not  Follow  Its  Own  Policies  On  Award  Fee 
On  Occasion,  Award  Fee  Evaluation  Criteria  Are  Poorly  Explained  Or  Justified  and 
Communication  bf  Award  Fee  Goals  and  Criteria  Are  Not  Clearly  Explained 
It  Is  Difficult  to  Establish  the  Relationship  Between  Awards  For  month-to-month 
Activities  to  the  Goals  Of  A  Multiple-Year  Program.  The  Linkage  Is  Not  Always 
Apparent 

Administration  of  Award  Fee  Criteria  Can  Change  Post  Award  and  Create  Problems 
During  Contract  Execution 

Government  May  Not  Manage  Or  Evaluate  Award  Fee  Criteria  as  Agreed  /Planned 
•  Post-award  administration  of  Award  Fee  contracts  is  time  and  resource  intensive 


£AU  . . .  and  the  Findings  Say: 

Defense  Acquisition  university  20  July  2006  Industry  Day  Themes  collected  at  DAU  Headquarters 


5.  Carefully  Weigh  Industry  Concerns 

•  Government  Personnel  Are  Not  Adequately  Trained  in  Managing  Award  Fee  Contracts 

•  Desired  Outcomes  Are  Not  Always  Driven  By  The  Award  Fee  Because  Of  Insufficient 
Funds  Available  and  Subjectivity  Of  The  Final  Evaluation. 

•  Inconsistency  In  the  Timing  Of  the  Award  In  Line  With  The  Evaluation  Criteria 
And  Uncertainly  Of  Expected  Profitability  Before  Award  Pose  Additional  Problems 

•  Contracting  Parties  /Stakeholders  have  Different  Perceptions  of  Award  Fees 

Purposes  | 

•  In  Some  Cases,  There  Is  Government  Failure  to  Understand  the  Economics  of 
Defense  Contracting  and  Its  Impact  On  Government  Contractors 

•  From  Time  to  Time,  There  is  Inappropriate  Use  Of  Award  Fee  Contracts 

•  Award  fee  is  not  targeted  at  creating  fair  shareholder  value  (or  financial  advantage  to 
the  private  company)  in  line  with  actual  performance.  Metrics  are  sometimes  not 
meaningful  and  are  "fuzzy"  in  line  with  "fuzzy"  requirements.  Sometimes  they  are  too 
subjective  and  do  not  measure  outcomes  that  are  sought  by  DoD 

•  Award  fees  that  require  the  contractor  to  exceed  the  requirements  of  the  contract 
motivate  requirements  creep  or  “goldplating” 
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Recommendations 


•  Maximize  two  existing  Continuous  Learning  Modules  (CLMs)  to  help 
guide  organizations  with  their  incentive  selection  and  subsequent 
pathway. 

-  Contractual  Incentives  (CLC-018):  focuses  on  balance  between 
government  and  industry  goals  and  objectives  in  crafting  an 
effective  incentive  strategy 

-  Provisional  Award  Fees  (CLC-034):  addresses  the  new  2003  rule 
that  permits  award  fee  payments  to  be  made  anytime  prior  to  the 
interim  or  final  evaluation. 

•  Exploit  the  increasingly  popular  collaborative  medium  called 
Communities  of  Practices  (COPs) — DAU  has  already  established  a 
site  on  the  ACC,  “Award  and  Incentive  Fee  Contracts.” 

(https://acc.dau.mil/CommunitvBrowser.aspx7icM05550). 

-  Provides  access  to  a  wide  array  of  documented  lessons  learned 
regarding  incentives 

-  Provides  the  community  a  bridge  to  the  source  of  experts  who 
face  incentive  challenges  every  day 

-  Reinforces  useful  incentive  practices  and  techniques 

•  Develop  a  much  more  comprehensive  Incentive  Contracts  CLM 
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David  M.  Walker 

Comptroller  General  of  the  United  States 
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2.  Do  you  believe  they  are  an  effective  way  to  create  incentives  with  contractors?  In 
other  words,  do  they  improve  contractor  performance? 

Award  and  incentive  fees  can  be  an  effective  tool  if  properly  designed  and  effectively  administered. 
However,  for  these  fees  to  be  effective,  DOD  must  address  the  underlying  problems  in  its  acquisition 
system  and  more  directly  link  the  fees  to  the  outcomes  it  wants.  Because  the  weapon  system  programs 
that  result  from  this  system  are  in  many  cases  unexecutable  and/or  subject  to  changing  “requirements”  or 
funding  levels,  DOD  has  been  unwilling  to  hold  its  programs  or  its  contractors  accountable  for  achieving 
the  very  acquisition  outcomes  it  has  identified.  As  a  result,  fees  are  paid  even  when  outcomes  do  not 
meet  expectations.  Addressing  these  broader  acquisition  issues  and  strengthening  the  link  between  fees 
and  acquisition  outcomes  can  increase  the  accountability  of  DOD  programs  for  fees  paid,  of  contractors 
for  results  achieved,  and  the  likelihood  that  these  fees  will  motivate  the  contractors  and  be  an  effective 
tool  for  the  government. 

3.  Do  you  believe  we  should  discontinue  the  use  of  award  and  incentive  fees? 

No,  we  do  not  believe  they  should  be  discontinued.  Award  and  incentive  fees  can  be  useful  if  they  are 
used  in  the  appropriate  setting.  Each  contract  type  has  a  use  based  on  the  level  of  risk  involved.  The 
problem  occurs  when  you  proceed  into  programs  without  realistic  requirements  and  sufficiently  mature 
technologies  on  which  to  base  realistic  cost  and  schedule  estimates  and  attempt  to  offset  that  increased 
risk  by  offering  award  fees  to  motivate  the  contractor  to  overcome  that  risk.  The  important  question  is: 
Have  you  adequately  defined  and  established  appropriate  criteria  that  enable  you  to  measure  outcomes? 
And  finally,  how  do  you  apply  those  criteria  in  determining  the  level  of  fee  that  can  be  justified?  We  have 
made  several  recommendations  to  this  effect,  and  DOD  has  responded  favorably  with  new  guidance  to 
link  award  fees  to  acquisition  outcomes.  However,  as  with  other  recommendations  we  have  made  related 
to  DOD  weapon  system  acquisitions,  the  key  will  be  how  this  new  policy  is  implemented. 
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An  Aggregate  View 


Key 

Attributes 


Differentiation 


Relevant,  Achievable  and  Enduring  Measures 


Frequent  and  Unambiguous  Communication/Feedback 


Trained  and  Experienced  Personnel 


No  Base  Fee 


Base  Fee 


Cost  Plus  Incentive  Fee  (CPIF)  Cost  Plus  Award  Fee  (CPAF) 

Description 


Provides  for  the  initially  negotiated  fee  to  be  adjusted  later  by  a 
formula  based  on  the  relationship  of  total  allowable  costs  to  total 
target  costs;  specifies  a  target  cost,  a  target  fee,  minimum  and 
maximum  fees,  and  a  fee  adjustment  formula.  After  contract 
performance,  the  fee  payable  to  the  contractor  is  determined  in 
accordance  with  the  formula.  The  formula  provides,  within  limits, 
for  increases  in  fee  above  target  fee  when  total  allowable  costs 
are  less  than  target  costs,  and  decreases  in  fee  below  target  fee 
when  total  allowable  costs  exceed  target  costs.  This  increase  or 
decrease  is  intended  to  provide  an  incentive  for  the  contractor  to 
manage  the  contract  effectively.  When  total  allowable  cost  is 
greater  than  or  less  than  the  range  of  costs  within  which  the  fee- 
adjustment  formula  operates,  the  contractor  is  paid  total 
allowable  costs,  plus  the  minimum  or  maximum  fee 


•  Description 

Provides  for  a  fee  consisting  of  (1)  a  base  amount  fixed  at 
inception  of  the  contract  and  (2)  an  award  amount  that  the 
contractor  may  earn  in  whole  or  in  part  during  performance  and 
that  is  sufficient  to  provide  motivation  for  excellence  in  such 
areas  as  quality,  timeliness,  technical  ingenuity,  and  cost- 
effective  management.  The  amount  of  the  award  fee  to  be  paid  is 
determined  by  the  Government’s  judgmental  evaluation  of  the 
contractor’s  performance  in  terms  of  the  criteria  stated  in  the 
contract.  This  determination  and  the  methodology  for 
determining  the  award  fee  are  unilateral  decisions  made  solely  at 
the  discretion  of  the  Government. 


Incentive  Contracts 

•  Suitable  when  a  firm-fixed-price  contract  is  not  appropriate 
Motivates  Contractor  Efforts  that  Might  not  Otherwise  be  Emphasized 
•  Discourages  Contractor  Inefficiency  And  Waste 
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How  this  Research  Study  Came  Together 
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Back-Ups 
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Management  Deliberation  Center 


State-of-the-art  facility  designed  and 
developed  to  support  group  collaboration. 
Participants  can  contribute  anonymously  and 
simultaneously,  or  at  different  times.  The 

software  also  collects  and  tabulates  votes, 
graphically  and  statistically  displays  results, 
and  accesses  other  packages  and 
documents. 


